Rigorous meaning of McLennan ensembles 
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We analyze the exact meaning of expressions for nonequilibrium stationary distri- 
butions in terms of entropy changes. They were originally introduced by McLennan 
for mechanical systems close to equilibrium and more recent work by Komatsu and 
Nakagawa has shown their intimate relation to the transient fluctuation symmetry. 
Here we derive these distributions for jump and diffusion Markov processes and we 
clarify the order of the limits that take the system both to its stationary regime 
and to the close-to-equilibrium regime. In particular, we prove that it is exactly the 
(finite) transient component of the irreversible part of the entropy flux that corrects 
the Boltzmann distribution to first order in the driving. We add further connections 
with the notion of local equilibrium, with the Green-Kubo relation and with a gen- 
eralized expression for the stationary distribution in terms of a reference equilibrium 
process. 



INTRODUCTION 



According to McLennan 



20 



2l| . the stationary density of an open mechanical system 



away but close to thermal equilibrium can be written in the modified Gibbs form 

z 

with the nonequilibrium correction W directly related to the entropy production or to the 
dissipation in the driven system. An essential feature of the formula, not quite visible yet, is 
that the distribution p is described in terms of macroscopic parameters only, such as external 
temperature and driving fields. It was also expected "that some formal advantages may be 
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offered by an approach to nonequilibrium phenomena in which the Gibbs ensemble plays a 
more prominent role" (from the second paragraph in 20| ) . Because of the suggested physical 
interpretation, this proposal opens the possibility to construct nonequilibrium statistical 
ensembles based on meaningful physical quantities, see also [h[ [3] for older and 22] for 
more recent work. However, (11.11) in 20| being just the result of a formal perturbation 
calculation (together with some projection techniques), there have remained a number of 
difficulties with the exact meaning of this proposal as well as with its scope of generality. 
We mention some of these problems, cLS £1X6 clarified in the present paper: 

(1) What entropy production does the correction term W represent? — It can only be 
some transient component of the total entropy production as the total entropy production 
clearly diverges in the long-time (stationary) limit. Moreover, this divergence (equal to the 
steady entropy flux) is in fact of order 0(e 2 ) in some 'distance of equilibrium' e since it 
comes from the product of thermodynamical forces and fluxes, both being 0(e). The point 
will be that the transient irreversible part of the entropy production and its linear part are 
both finite: they coincide up to 0(e) and give a valid first-order correction to the Boltzmann 
distribution as in (11.11) . 

(2) Is the proposal also valid on different levels of description than for mechanical 

□ 

systems? — The formal perturbation approach as in [20( does not reveal the essence and 
the physical generality of the proposal. Here the insight comes from dynamical fluctua- 
tion theory: formula (11.1)1 is basically a consequence of the transient fluctuation symmetry, 
8|. In other words, it follows from the local detailed balance assumption which determines 
the time-antisymmetric structure of the space-time distribution in terms of the history- 
dependent entropy fluxes, cf. [13I. [l4|. We make that visible for Markov processes. 



an 

in (alii] 



Can one go beyond close-to-equilibrium? — As explained in |8j and further applied 



lOj, one can in principle obtain a formal perturbation series for the stationary distri- 
bution based on (all) the cumulants of the transient entropy production. An interpretation 
has been given for the second-order expansion where the divergences cancel out by a 
different way than explained in the present paper. We instead present a generalization 
involving the so called dynamical activity or traffic, an advantage being that the evaluation 
is now from the start to be done under a reference equilibrium process. 



We consider Markov processes of two types, jump and diffusion processes. Yet for sim- 
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plicity we reserve the next section to Markov jump processes; the diffusion case is formally 
completely similar. We explain the relation with local equilibrium in Section III Dl In Sec- 
tion II I II we make some specific remarks on the diffusion case and we also take there the 
opportunity to illustrate an alternative to the derivation in Section III Bt As an application, 
the Green-Kubo relations are derived in Section IIIIBI An illustration of the McLennan- 
algorithm for an underdamped case is given in Section IIII CI We end, in Section IIV| with a 
generalization away from equilibrium. 



After introducing some notation and basic concepts in the case of jump processes, we 
give our main result which is a rigorous version of the McLennan formula. A comparison to 
another approach and further remarks are added. 



Consider a continuous time Markov proces x t ,t > 0, taking values in a finite state space 
3 x,y, . . .. The transition rates are X(x, y) > for jumps between the states x — > y. The 
Master equation for the probability /it(x) of state x as function of time t is 



with some given initial law jj, = /i at time zero. 

Physical input distinguishes between equilibrium and nonequilibrium dynamics. An equi- 
librium dynamics (with subscript 0) satisfies the condition of detailed balance, i.e., 



where po(x) cx e~@ u ^ for some potential U and inverse temperature j3, is then stationary. 
This relation expresses the time-reversibility of the stationary equilibrium process. For 
nonequilibrium systems, detailed balance (1H.2|) gets broken. An extension is known as the 
condition of local detailed balance. In terms of a potential U(x) and a work function (or 
driving) F(x,y) = —F(y,x), the rates now satisfy 



II. MARKOV JUMP PROCESSES 



A. Set-up and assumptions 




(II.l) 






(II.3) 



i 



where (3 > can still be interpreted as the inverse temperature of a reference reservoir, but 
that is not necessary except for setting the right units. 

We can rewrite the local detailed balance condition (III. 31) as 



p (x)\(x,y)= 1 (x,y)e% F ^ (II.4) 

for a symmetric j(x,y) = j(y,x), which here is arbitrary. 

In the present paper we are concerned with the close-to-equilibrium regime where F 
is small. To make it precise, we parameterize the distance to equilibrium explicitly by 
assuming that j(x,y) = ■y £ (x,y) and F(x,y) = F e (x,y) (and hence also X(x,y) = \ £ (x,y)) 
depend on a parameter e G [0, e ]. With no loss of generality we let F £ (x,y) = eFi(x,y). 
As becomes obvious later, the e— dependence of r y E (x, y) is irrelevant for the first-order 
calculations. 

We also consider the probability of trajectories, or rather, how to obtain probability 
densities in path-space. For this we start with a probability law p at time zero for the 
Markov process, and write for its path-space distribution over a time interval [0, T]. 
That has a density with respect to the corresponding stationary equilibrium process Vo 
with rates Xq(x, y) and starting from po, explicitly given by the Girsanov formula 



dV PoOo) 



ex P {- / (£(*,) -£o(* f ))d*+ Y, l»S w X " ,X ;U (H.5) 

L JO Q ^ T A {X t -,X t )) 

where u> = (x t )J =0 , x t G Q, is a piecewise constant right-continuous trajectory, with the 
escape rates 

and with the last sum in the exponent being over the jump times t where the state changes 
from x t - to x t . Mathematical details are found in, e.g., Appendix 2 of 
From (III.5j) . the path-space action A in 



dV,(u) = dV (u) e~ A ^ (II.6) 

equals 

AM = exp{/ T (^)-a^))dt- £ ^ wT'r^ } 

V0 0<f<T A 0\ x t-,Xt) J 
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As a result, its time- antisymmetric part is 

S£» = A(9u)-A(u) 

= (3 F ^t-,x t ) {11.1) 

0<t<T 

where the time-reversal is the right-continuous modification of 9uj = (xT~t)f=o f° r anv 
uj = (xt)J =0 . We have used that the first integral in the exponent of (1II.5j) is time-symmetric, 
and that (111.2l) - (111.4j) combine to produce the forcing in the sum over jump times. We 



recognize the resulting (u) as the 'irreversible' part in the entropy flux as function of the 
path uj. Note that the pathwise relation (111.71) between the time-reversal symmetry breaking 
and the entropy flux is a consequence of condition (III. 3ft . For general arguments see e.g. [18]. 



The mean value of that irreversible part of the entropy production is obtained by taking 
the average of (III. 7}) with respect to our process, using its Markov property: 

/Mi 

Jo r ^ i 



= (3 J dt^2fx t (x)^2\ £ (x,y) F £ (x,y) /j Lg x 

^° x y^x 

= pJ dt(j2^e(xt,y)F e (x t ,y) i 



y^x 

Hence, for fixed T we have to first order in e 

cT 



(Om = ^ J dt(w 1 (x t ))l + 0(e 2 ) (11.9) 
where the averaging (-)° is now over the equilibrium reference process started from p, and 

w 1 (x) = J2x (x,y)F 1 (x,y) (11.10) 

y^x 

is the linear term in the mean entropy flux when at state x. 

B. McLennan formula 



To be explicit about the various dependencies, we write p e T for the e— dependent solution 
at time T to the Master equation (III.ip . started from the equilibrium law p = Po- The 
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smoothness of the deformation is assumed uniformly in time T, and we write p £ = lim^ p e T . 
We also denote the stationary entropy flux by a £ \ it is given as 

1 

T 



f Y}pe{x)K{x,y) - p £ (y)X £ (y,x)]F £ (x,y) 



x,y 

Ps{x) _ Pe{y) 

Po{x) p {y) 



e/3 / \ Peyx) 

7 L^^'W 77^~77^ F 1 {x,y) + o{e) (11.11) 



2 

independently of time span T. We finally recall the linear term w\ from (III.lQj) . 

Theorem II. 1. Suppose that the equilibrium process fill. 2[) is irreducible. The following 
limiting identities are verified: 

lim lim- log = lim i im Ilog^^ (11.12) 



r+oo 

(3 dt( Wl (x t ))° x (11.13) 
Jo 



Moreover, 



r+oo 

e(3 / dt ( Wl (x t )) x = lim [(Sj RR ) x - a £ T] + 0(e 2 ) (11.14) 
Remark II. 2. According to the above result, the stationary distribution has the form 
p £ (x) = po(x) expj-e/3 / dt (wx(x t ))l + 0(e 2 ) 



e W {\imJa £ T-(Sl K ) x }+0(e 2 )} 



[11.15) 



-TT+c 

which is consistent with the original McLennan's proposal (II. ip in the sense that it identifies 
the correction term W as the transient part of the 'irreversible' entropy production for the 
process started from state x. Notice that this transient part is 0(e), in contrast to the 
stationary entropy production rate which is 0(e 2 ); the latter being also the leading order of 
the long-time divergence that needs to be removed. Hence, loosely speaking, the McLennan 
proposal is all correct for close-to-equilibrium processes provided that the divergence present 
in higher orders in e is killed by a suitable counterterm. 

Proof. The first equality (III. 121) follows from the irreducibility of the reference equilibrium 
process. The e— dependent process is obtained by its smooth deformation, see ( III.3p - (III.4p . 
Therefore, p £ T — > p £ uniformly in e e [0, £i] with some < E\ < e . 
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In order to prove the equality fill. 13j) . the point of departure is the transient fluctuation 
symmetry. The formula (III.6P obviously implies 

when starting (in the left-hand side) the nonequilibrium process from the equilibrium law 
Pq. Since the equilibrium process Vq is time-reversal invariant, we have for (III. 71) 

and hence, for all functions / on path-space, 

(f) po = (JO exp(-5 i T RR )) po (11.16) 

That is an exact (for all finite times T) fluctuation symmetry. Take in (111.16j) f(uj) = 5 XT=X , 
the Kronecker-delta function equal one if the trajectory ends up at state x and zero otherwise. 
We get 

p e T (x) = p (x) (e~ S mn) x (11.17) 

where the right-hand side averages over the nonequilibrium process started from the state 
x. We substitute ( \ll.7\i and we use that the Poisson number of jumps has all exponential 
moments, to expand the exponential in (111.17)) . Using (III.8j) . it is then easy to verify that 



1 



Hm-log(e-V)^-/3 dt Wl (x t )) (11.18) 

elO E \J fx 

which has a limit as T f +oo since, uniformly in the initial x, the equilibrium process relaxes 
exponentially fast to its stationary law for which p (x)wi(x) = by (111.21) . That proves 
formula (llLT3|) . 

We now turn to (1II.14j) . For all initial laws p, 

-<r,T = l3 [ dt J> t (x) - Pe{x)\Y,K{x,y)F £ {x,y) 

has a limit T j +oo. Since all terms are uniformly bounded, we can here freely exchange 
the limits T j +oo and e [ 0. The T— limit has leading order in e, for £ J, 0, 



r+co 

/ d ^ J^°(aO - po( x )} Yl A °( X) v) 

J ° x y^x 

/+oo 
dt J2p° t (x)J2\o(x,y)F 1 (x,y) (11.19) 
x y^x 

because F±(x,y) is antisymmetric and po(x)Xo(x,y) is symmetric under x y. That proves 
( flTTl) . □ 



8 



C. Variations 

What is mostly new about the above arguments is the point of departure fill. 16h . which 
naturally links McLennan's correction to the 'irreversible' entropy production, cf. Q]. 
There are other schemes that do not have this advantage; still they can be applied to obtain 
systematic corrections to the equilibrium distribution. We discuss one such a formulation 
and we apply it to obtain a different perturbation scheme not having an interpretation in 
terms of the entropy production. 

By using the fundamental theorem of calculus, the stationary measure p £ = p can be 
obtained in the form 

p(x) = p (x) + / dt e tL * L*p Q {x) (11.20) 
Jo 

for initial law p and with L*p(x) = 'Yl iyj L x {^{y-iX)p{y) — X(x,y)p(x)] the forward generator 
of the Markov jump process under consideration. Then, from (111.40 . 

L*po(x) = Po (x) h(x), h(x) = J2K^y)[e~ mx ' y) ~ 1] 

y^x 

is of order s, and 

e' L ° [ Po h](x) = Po (x)e tLo h(x) 
with L the backward equilibrium generator. Substituting to flll.20p . we get the expression 

- + 0O 



p E (x) = p (x) 1 + / dte tLo h{x) +0{e 2 ) (11.21) 
L Jo J 



Since 

we have rederived formula (III . 1 3|) . 



The scheme (lII.3j) - (1II.4j) in combination with the e-dependence according to F(x, y) 



eFi(x, y) is a special way of breaking the detailed balance condition. One easily encounters 
other physically relevant mechanisms. For example, suppose that for the reference equilib- 
rium dynamics transitions x ^ y between specific states are forbidden. We may imagine 
two uncoupled equilibrium systems. The nonequilibrium dynamics could introduce a small 
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coupling with for example 

X(x,y) = ek(x,y), X(y, x) = ek(y, x) 

for these specific transitions. We do not longer enjoy then the absolute continuity of the 
nonequilibrium process with respect to the equilibrium reference and the relations (III. 5ft - 
( III. 6}) break down. The entropy production as a function on path-space does not depend on 
e. Nevertheless, from (III. 201) we can still compute the linear correction to the reference law 
Po- It is exactly of the form (1II.21j) but with 



K*) = £ E \^f\ k ^ x ) - fc ( x > y)] = £ E k & y) ^~ Hx ' y) - ^ ( IL22 ) 



\-po(x) 

y+s-x y^-x 



and 



if \ , Po(x)k(x,y) 

* {x ' v) = iog lMkM (IL23) 

where the sum is over the for the equilibrium dynamics forbidden transitions from state x. 
The difference with nonequilibrium perturbations where one adds a small driving in a local 
detailed balance condition, as in fjll.3j) — flll.4p . is manifest. The correction to equilibrium is 
not of the form of an entropy flux. In other words, not all perturbations from equilibrium, 
even physical ones, lead to the same type of correction to the equilibrium distribution: the 
specific McLennan correction in terms of the irreversible entropy flux arises (only) by the 
change from detailed balance to local detailed balance by inserting some small driving. 



D. Example: boundary driven lattice gas 

The following example makes the above considerations and formula? more concrete. We 
also take the opportunity to explain the relation with local equilibrium. 



We consider a lattice gas on the sites {— N, . . . , 0} where the configurations x, y indicate 
the vacancy or presence x (i) — 0, 1 of a particle at each site i. The dynamics distinguishes 
two ways of updating. 

We concentrate on the case where there is a bulk conservation law as in Kawasaki 
dynamics. To be specific we choose the bulk transitions as an exchange of nearest neighbor 
occupancy: we write x l)l+l for the configuration that equals x except that the occupations 
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at sites i and i + 1 are interchanged. Then, 

A(x, y) = a, exp(-^{U(y) - U(x)}) when y = x { ' i+ \ i = -N,...,-l (11.24) 

At the left and right boundaries, there is a birth and death process: with y % the configuration 
for which at site % the occupation has been inverted, 

\(x, y) = exp(— 7^{U (y) — U(x)}) exp(— ^ L (2x(i) — 1)) when y = x\i = —N, 

with hi playing the role of chemical potential of left and right reservoirs. 
Suppose now that Oj = 1, 6_jv = 0,fco — £ which is a close-to-equilibrium system in the 
sense of Section Hi Aj the equilibrium law is po(x) oc exp[—/3U(x)], reached for e — 0. The 
expression (III. 101) becomes 

w x {x) = exp(-^{U(x°) - U(x)}) [2z(0) - 1] (11.25) 

On the other hand, consider the function g(x) = X^=-jv v i x (^)^ f° r some profile t>j. Then, 

-l 

L <7(z) = V h - + v exp[-/3{U(x°) - U(x)}][2x(0) - 1] 

i=-N (11.26) 

+ exp[-/3{U(x- N ) - U(x)}][2x(-N) - 1] 
with systematic currents over the bonds + 1) 

ji(x) = A(z,z M+1 )[x(i + l) 

as they appear in the continuity equation for local particle number. Choose Vi = 1 + i/N 
which makes vo = 1, V-n = 0, and v i+ i — Vi = 1/N. Comparing (111.25j) with fill. 26 j) yields 

i=-N 

For the McLennan-form (III. 131) we must take the time-integral of (111.250 so that 

r r e8 _1 f +OD } 

p £ {x) oc p (x) expje/5 ^ v iX (i)j expj-^ ^ / dt e iL °j 4 (x)] (11.28) 

This expression (III. 28|) for the approximate stationary distribution is of the form of local 



equilibrium for the conserved quantity (particle number) containing the linear profile Vi for 
the (local) chemical potential. The remaining integral 



r+oo i —1 
Jo iV i=-N 
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makes mathematical sense because the local currents die out exponentially fast for the 
equilibrium dynamics. It was also discussed in the same context as formula (3.49) in (|. 
As iV gets large, the average current gets even smaller for each fixed time. It appears, 
without proof, that for boundary driven spatially extended systems the McLennan-regime 
close-to-equilibrium can also be reached by taking N large, for fixed chemical potential 
difference, while that is not included in formulations such as (111.13p . 



III. DIFFUSION PROCESSES 

In this section we treat Markov diffusion processes and we give an alternative derivation 
of the main result. 

A. General argument 

We consider the class of d— dimensional inhomogeneous Ito-diffusions 

dx t = { X (x t )[F(x t )-VU(x t )] + V-D(x t )}dt+y/2D(x t )dB t (III.l) 

defined on a torus (i.e., we assume periodic boundary conditions). We use the notation 
V ■ D for the vector with components Y^k^i^M and assume D = x/ft', the latter being 
the Einstein relation as a variant of the local detailed balance condition for diffusion. The 
d— dimensional vector dB t has independent standard Gaussian white noise components. We 
assume the fields F(x), U(x), and x{ x ) are smooth and the matrices xi x ) are symmetric 
and strictly positive at all points x. 

To each distribution with density \i there is associated a current density 

U = X(F - W)/i - DVfi (III.2) 

and the stationarity of the law \i — p is equivalent with the condition V • j p = 0. The 
gives the expected profile of the 'real' particle current at given density /i in the sense that 
for any smooth function /, 

(J f(x t ) o dxt)^ = I dt J f( x )jM dx ( IIL3 ) 
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The left-hand side is the average of a Stratonovich-stochastic integral under the diffusion 
process started at time t = from density p,. In particular, the instantaneous mean work of 
the force F is then 

WM-fF-i^-f^ (II..4) 

for 

w = F ■ X F - X F ■ VU + V ■ (DF) (III.5) 

In order to check the McLennan-proposal we isolate the linear order in (lIII.4p . We take the 
case F = 0, po = exp[— /3U]/Z > as the equilibrium reference and we expand with small 
parameter e: 

F = eF 1 + ... 

w = ewi + . . . (III. 6) 

p = p e = p (l +Sht + ...) 

assuming smooth behavior around e — 0. From (1III.5I) . 

Wl = V ■ (DF,) - X F, ■ VU = V - ( f xFl) (III.7) 

PPo 



the linear term in the mean work performed by the force F. It turns out, as in (1II.13j) and 



in agreement with McLennan's proposal, that hi is given in terms of the mean total work 
performed on the particle started from x under the reference dynamics. 

Theorem III.l. Suppose the process f llll.lj) converges exponentially fast and uniformly in 
initial states to its unique stationary probability distribution with smooth density p around 
Po as in ( jIII.6|) . Then, 

h 1 (x) = -p(J w^xjdt^ (111.8) 
Proof. The current (IIII.2I) can be rewritten in terms of the reference equilibrium density 

U = ^X(F - VU) - DVp = fi X F - Po^V(^) (III.9) 

Po 

so that the stationarity condition V • j p = implies 

= V- [p DV(^-)-p X F] 
Po 

= Po DV ■ V(^) + Po (V ■ F>) ■ V(— ) — PoX VU ■ V(^) - V ■ ( PX F) (111.10) 
Po Po Po 

= p L (^)-V-(pxF) 
Po y 
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with L the backward reference equilibrium generator. To linear order, that gives 

Lofo = Pwi (III.ll) 



with W\ from flIII.7j) 



As the relaxation to equilibrium is fast enough, Lq can be inverted on the space 

Q L = {g: J g Po dx = Q} (111.12) 
and since ui\ G fi -1 , the stationary solution must have first order 

h = fiL- Q l w 1 (111.13) 

or 

hi{x) = -pj (e* Lo wi)(x)dt = -P(J wi{x t )dty (111.14) 
as required. □ 

One might be tempted to write 



p(f w(x t )dt) +0(e 2 ) (111.15) 



Po Vo 

(i.e., with the full work and possibly under the nonequilibrium measure) but this is only 
formally true in the sense that the 0(e) terms on both sides are equal; however the second 
term on the right-hand side generally diverges now because of its 0(e 2 ) part. Another way 
to see that is by observing that w SjL fl 1 - in general, in which case Lq 1 w does not exist. 

Still, one can proceed similarly as in the case of jump processes and add a suitable 
counter-term on the right-hand side of (IIII.15I) . All that explains what is actually the 
rigorous meaning of McLennan's proposal: to correctly describe the first order correction, 
one is not allowed to deal with the full transient entropy production unless the divergences 
coming from the high-order corrections are removed. For safe first-order calculations one 
needs to take the linear part of the entropy production functional only, as done above in 
Theorem HII.11 



B. Green-Kubo relations 



An expression for the close-to-equilibrium stationary density obviously yields information 
about the stationary current in linear response around equilibrium. That provides another 
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derivation of the well-known Green-Kubo relations between the current and equilibrium 
time-correlations. 



We use the same notation as in the previous section but this time we need to indicate the 
dependence on the driving force F, e.g., the linear part of the work (IIII.7I) is now written as 

< = V • {p ° xFl) (111.16) 
PPo 

By expanding the mean stationary current (IIII.2P (/i = p) in powers of e, rf = ejf + . . ., 
the leading term has the form 

jf = pox[^i-V(Lo 1 <)] (in.17) 

where we have substituted the McLennan form. Suppose G = eG\ + ... is another smooth 
field. Then we have, up to order e 2 , that f G ■ j F dx = e 2 f Gx ■ jf dx + o(e 2 ) and 

J Gt • jf dx = J po[Gi ■ X Fi + pwfL^wf} dx (III. 18) 

Since L is self-adjoint with respect to the scalar product (/, g) = f p fg dx (and Lq 1 is 
therefore self-adjoint on Q- 1 ) and as the matrix \ is symmetric, we immediately get the 
Onsager reciprocity relations in the form 

G x ■ jf dx = J F x ■ jf dx (III. 19) 

Note that for F = G the formula (IIII.18I) gives the leading (= second order) term in the 
expansion for the stationary instantaneous mean work W F (p F ), see ( lIII.4p . whereas for 
F ^ G it corresponds to the 'interference' contribution when the driving fields are added: 

W F+G (p F+G ) - W F (p F ) - W G (p G ) = 2e 2 J Gx ■ jf dx + o(e 2 ) (111.20) 

Theorem III. 2. Under the same assumptions as in Theorem \III. li 

J Gx-) F dx = J dxp [ Gx ■ X Fx + pw G L l w F ] 



(111.21) 



where o indicates the Stratonovich integration (incorporating the scalar product) and the last 
expectation is under the equilibrium process. 
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Remark III. 3. The middle term in 21 [) is what follows from applying the McLennan 
formula to the mean current close-to-equilibrium. The equality flIII.2ip then yields the 
linear response formula for the close-to-equilibrium stationary current in terms of current- 
current time correlations, its right-hand side. The result can be formally summarized as 
saying that 

f p {x) = J TZ(x, y) F(y) dy + o(e) (111.22) 
with a symmetric response function lZ(x,y) = lZ(y,x) given by 

K(x,y) = lim J^(J T (x) J T (y))° (111.23) 

and 

J T ( X ) = [ 6{x t -x)o dx t (111.24) 
Jo 

is the time-integrated empirical current density. 

Proof. As the first equality in (1III.21H is formula (1III.18I) . we only need to prove the second 
equality there. 

Using the standard relation between the Stratonovich and the Ito integrals, each inte- 
gration along the equilibrium process (corresponding to F = in (1III.1I) ) on the right-hand 
side of f lIH.18j) can be computed as follows: 



/ F 1 o dx t = [ Fi • dx t + I J2 D 

JO Jo Jo ui 



dF u , 
ki~^- dt 



dx 



= [-F 1 - X VU + V-{DF 1 )]dt+ F 1 ■ {2Dfl 2 dB t (HI.25) 
Jo Jo 

= [ w[dt + [ F l -{2Dfl 2 dB t 
Jo Jo 

We must substitute (IIII.25P into the right-hand side of (jHI2ip . We start with the cross 
terms, one of which is 

wf dt J F 1 ■ (2D) 1/2 dB s ^ = wfdtj Fi ■ (2D) l/2 dB s ^j 

£ wf dt [jT F 1 ■ (2D) 1/2 dB s + 2 J wf ds] )° (IH-26) 

wfdt [ wf ds' 
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In the second equality we have applied the time-reversal of the last equality in (1III.25I) . 
using that the Stratonovich-integral is time-antisymmetric and that the equilibrium process 



is time-reversal symmetric. Analogously, 

J w f dt J o G i ■ (2Dy/ 2 dB s y = ~^{J w ? dt l w ? ds )° 



T r t 







111.27) 



= -2^ J w^dt j w{ ds 
Hence, both cross-terms together give 

fT 



2( / wfdt / w{ ds) (111.28) 
o Jo 



As a consequence, the correlation is then 

T f T \ o 

Gi(x t ) o dx t / Fi(x s ) o dx t 
Jo 



2^ J Gx • I>Fi(x t ) di)° - (j wf(x t )dtj w[(x s )d s y 

p{l-a)T pT-t 

2T(G 1 ■ DFi)° - dt ds (wf(x t ) w[(x s ))° + O(aT) 

JaT J-t 



/+oo 
ds (wf(x ) w({x s ))° + O(aT) + 0(Te~ KaT ) 
-oo 

for an arbitrary < a < 1/2 and with k the rate of exponential decay of the time correla- 
tions. Dividing by 2T and taking the limits T j +oo and then a ! 0, one finally obtains 

1 / f T f T \ /" +00 

lim — (/ G x {x t )odx t F 1 (x s )odx s ) =(G 1 -DF 1 )°- ds {wf e sL °w F )° (111.29) 

□ 

Remark III. 4. The same proof applies for jump processes. One then has the analogues u>f = 

E y Ms, y), ^(^ 2/) = --^0/, x )> and jf = t(s, v) i F ( x i y)+h F (x)-h F (y% y) = 

Po(x)\o(x,y) = 7(2/, x), h F (x) = Lq wf (x), p F (x) = po(x)[l + h F (x)]. Theorem IIII.2I applies 
equally under the condition of uniform exponential relaxation. 



C. Even and odd variables: example 

For models whose configurations do not transform trivially under time reversal, the above 
construction requires a generalization. If the involution it, it 2 = 1, is the kinematical time- 
reversal on the state space, the detailed balance condition takes the generalized form 

L+ = nL 7i, p 7T = p (III. 30) 
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for the adjoint Lq in the sense J f(L g) p dx = J (Lq f)g p dx. Typical examples are 
dissipative mechanical systems, e.g. underdamped diffusion processes, with states given by 
both position and momentum variables for which w turns the sign of the momentum. Models 
of heat conduction are a prime example, and the close-to-equilibrium analysis would imply 
Fourier's law — if indeed the equilibrium time correlation functions can be controlled in the 
Green-Kubo formula, which remains highly non-trivial, see e.g. l|, |4|. 

Since the McLennan form is fundamentally a consequence of the transient fluctuation 
symmetry, see Section IIIB| the above arguments need only minor changes. Instead of 
repeating the whole derivation, we restrict ourselves to a simple example that elucidates 
essential points. 



We consider the model of a linear RLC-circuit with two resistors in series and one external 
voltage (E); cf. Section 3.3 in Q]. The two independent free variables are the potential U 
(even) over the first resistance R± and the current / (odd) through the second resistance R 2 - 
To have a nontrivial transient regime, an inductance L is added in series with the resistors 
and also a capacitance C is connected in parallel with the first resistor. The environment is 
at inverse temperature f3. 

The stochastic dynamics for (U, I) is given by Kirchoff 's laws combined with the Johnson- 
Nyquist theory according to which resistances R\ y2 immersed in a thermal environment are 
source of an extra random voltage; these can be modeled as independent Brownian motions 
with variance Ri^fl -1 per unit time. Altogether, 

CdU t = (it - §■) dt + (/3Ri)~ 1/2 cLB ljt 

v R ^ (in.31) 

IAI t = (E — R 2 I t - U t ) dt + (PR 2 y 1/2 dB 2tt 

The reference equilibrium dynamics corresponds to E — 0, for which the stationary density 
reads p (U,I) oc exp{ — (CU 2 + LI 2 )/2] and the detailed balance condition (1III.30I) is 
verified with 7r(U,I) = (U,—I). In the driven case, E ^ 0, and by the linearity of the 
example it is again easy to compute the stationary density pe- Instead we use this example 
to illustrate and to verify the McLennan proposal (II. lj) . 

The goal is to get pe from physically identifying the transient entropy flux. The irre- 
versible part of the dissipation here equals f3 times the work done by the battery as a function 
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of the trajectory u> = {(U t , It),t G [0, T]}. Specifically, 



S r T R » = 0E f I t dt (111.32) 
Jo 



Of course, when in doubt, one can compute it also by the general algorithm as the time- 
antisymmetric part of the logarithmic density of the path-measure with respect to its time- 
reversal, cf. flll.5p - flll.10p . By the linearity and homogeneity of the system, the source voltage 
E takes over the driving parameter e of the previous analysis and, using the notation from 
there, the expected irreversible part of the dissipation is 

{SO* = E [ T (Mlt))ldt, m = PI (HI.33) 
Jo 

cf. fill. 9j) - flII. 101) or flIII.4p - flIII.5j) . It is now easy to check that the stationary density satisfies 
the identities 

l°g —(U,I) = -E( f +OO Wl (x t )dt) ' + + O(E 2 ) 
Po \Jo fu,j 

= (3E{LtY l I + 0{E 2 ) (HI.34) 

^ + R2 R\ + R2 ' ^ ^ 

where the equilibrium dynamics on the first line runs according to the generator Lq, i.e., 
backwards in time. Since it is identical to vrL vr, it only generates sign changes in the 
computation — that is the only point in which the previous analysis must be modified. The 
result of the McLennan theory thus gives pe correctly as the Gaussian density with the same 
covariance matrix as po but with nonzero averages 

^ ^ Ri + R2 ^ ^ Ri + R2 ^ 

The point is that even in cases where computations would be more involved, the McLen- 
nan formula is in terms of a physical quantity that can often be written down without the 
need to go much into further details of the model. 



IV. GENERALIZATION BEYOND CLOSE-TO-EQUILIBRIUM 



It is natural to ask whether similar representations of the stationary distribution 
remain valid also beyond close-to-equilibrium. The correction to quadratic order has been 
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systematically explored in [8|, |9j, llOj , within the programme of steady state thermodynamics. 
Here we add a general expression, (1IV.2P below, from which a cumulant expansion around 
equilibrium could be started in principle. 



We look back at (III.5I) - (III.6|) that we now write as 

dP» = dPj(w)e- A W 

where the equilibrium reference P° is starting from the law /i. We decompose the action A 
into a time-antisymmetric and a time-symmetric part: 

S = AO - A, T = A6 + A 

where we have abbreviated fjll.Tj) to S. From flll.6p . the time-symmetric part T is the time- 
integrated excess in escape rates for jump processes. It is more generally related to the 
dynamical activity in t he p rocess. We have also called it traffic in the context of dynamical 
fluctuation theory, [15|, [l7|. We thus have 

dV, = dV° exp(^ T ^), dV P0 o6 = dV exp(-^t^) (IV.l) 

where the second identity uses the time-reversal invariance of the equilibrium process (started 
at po). The integrated form of the second identity reads 

(/M), = (/(fe)e^ (SM+TH) ) 

with the right-most expectation over the equilibrium process. The left expectation is for the 
nonequilibrium process starting in p so that, taking functions f(oo) = f{^t) of the state 
at a single time t, we get information about the approach to the nonequilibrium stationary 
density. For the finite state space Q, taking f(u) = S XT=X , we get 

Prob(x T = x) = p e T (x) = p (x) (e~^ s+T) ) x , x G SI (IV.2) 

which is an exact formula for the nonequilibrium density at time T, no matter how far from 
equilibrium, entirely in terms of the reference equilibrium dynamics starting at x. Recall 
that the exponent in the average is extensive in (large) time T while also of (small) order e 
around equilibrium. Together with the normalization condition 

(e^X = 1 ( IV - 3 ) 
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for all initial laws /x, as follows from the first identity in OIV.ip . this can be taken as the 
starting point for systematic expansions. In the first order around equilibrium, the expected 
entropy flux S and the expected traffic T are identical. That explains how (111.17)) and hence 



McLennan's formula follow from (1IV.2)) . That finally is why we call (1IV.2)) a generalization, 



still involving the irreversible entropy flux S but now also the traffic T. Note that all 
expectations in flIV.2)) — (IIV.3j) are under the equilibrium process, in contrast to a slightly 
different construction suggested in {^J which only uses the variable entropy production but 
with respect to the full nonequilibrium dynamics. We see that difference, equilibrium versus 
nonequilibrium expectation, also when comparing (1IV.2I) with (111.17)) where = S: 



Yet, starting from either of the two expressions, there remains the difficulty of writing down a 
general and physically meaningful expression of the stationary distribution p in a sufficiently 
explicit way, also because of generic nonlocal aspects in the relation between potential and 



stationary density, given a nonequilibrium driving, 
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3. 



Remark IV. 1. The expression f HV.21) or the original McLennan formula (II A\i is perhaps 



Remark 



related to what is argued to follow from a maximum entropy principle, cf. |3|, 
however that finding the correct constraints or observables for which to apply such a principle 
remains highly unclear. In particular, it appears that certainly beyond linear order around 
equilibrium, also the time-symmetric fluctuation sector must get involved, cf. ["bol ]. 

V. CONCLUSIONS 

McLennan's formula gives a Gibbsian-like expression for the steady law close-to- 
equilibrium under the condition of local detailed balance. The correction to equilibrium 
involves the transient entropy flux. It was seen before in 8j how that arises from a transient 
fluctuation formula. We have added mathematical precision in the order of limits (time 
versus distance from equilibrium). We have shown how it relates to local equilibrium and to 
the Green-Kubo relations and we have presented a generalization involving the dynamical 
activity. 

In our opinion it remains important to attempt a thermodynamic interpretation of also 
higher order corrections to equilibrium. 
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